CSE 431 Theory of Computation Spring 2014 


Lecture 2: April 3 
Lecturer: James R. Lee Scribe: Riley Klingler and Alexa Rust 


Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. 
They may be distributed outside this class only with the permission of the Instructor. 


2.1 Finite State Machines 


The simplest model of computation is a finite state machine or a finite automoton. Informally, it is a set 
of states with transitions between the states based on an input string from some fixed alphabet. There is a 
start state and a set of accept states. The machine accepts a string if the machine ends in an accept state 
after processing the string. 


The simplicity of finite state machines limits their computational power. It can be proven that the languages 
which can be recognized by a finite state machine are exactly the regular languages, languages which can be 
expressed using a regular expression. 


Example This language bab(a|b)*|ab*a(a|b)* is accepted by a finite state machine. 


Example This language L = {a"b" : n > 0} cannot be accepted by a finite state machine. 


2.2 Pushdown Automata 


A pushdown automaton is a finite state machine with the addition of a stack. This provides more com- 
putational power, because the stack allows an unlimited amount of memory. Thus pushdown automata 
can recognize more languages than finite state machines, for example the language L = {a"b” : n > O}. 
Pushdown automata like finite state machines are still a weak form of computation. For example the lan- 
guage L’ = {a"b"c” : n > 0} cannot be accepted by a pushdown automaton with only one stack (it can be 
recognized by an automaton with two stacks). 


2.3 Turing Machines 


Turing machines represent a universal model of computation. Informally a Turing Machine (TM) consists 
of a finite control, an infinitely long tape (possibly in both directions), a read/write head that can read and 
write symbols on the tape and move left and right. 


Church-Turing Thesis 2.1 Any reasonable model of computation is no stronger than a Turing machine. 


Since “reasonable” does not have a mathematical definition the Church-Turing thesis is not a statement that 
can be proved or disproved. 
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Definition 2.2 A Turing machine is a 7-tuple (Q, 2,1, ô, qo, daccept; Ireject) such that 
Q is is a finite set of states, 

. È is the input alphabet where the bank symbol U ¢ X, 

. T is the tape alphabet where % CT andueT, 

. ô is the transition function where ô : Q xT > Q xT x {L,R}, 

. qo E Q is the start state, 

. qaccept 18 the accept state, 

. Groject 18 the reject state. 
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We assume that if the head of the TM is at the left most tape entry, attempting to move left well keep it in 
the same location. 


Definition 2.3 If M is a TM over È, then L(M) = {x € X*|M accepts x} is the language of M. 
Definition 2.4 A language L is Turing-recognizable if L is the language accepted by some TM. 
Definition 2.5 A TM is a decider if it halts on every input. 


Definition 2.6 A language L is Turing-decidable if it is accepted by a decider. 


Example We give an example of a TM M. The TM M decides the language A = {0?"|n > 0}, i.e. strings 
of 0’s that are of length a power of 2. The TM works by crossing out 0’s on the tape to simulate repeated 
division by 2. We do this by crossing out every other 0 on the tape (ignoring already crossed out 0’s) starting 
with the second 0 on the tape. We accept if there is one 0 left on the tape, we reject if at any time there is 
a non-crossed out 0 at the end of the string. 


We give a formal definition of this TM: M = (Q, £, T, 4, q1, daccept; Greject), where Q = {q1, q2, 93, q4, q5, daccept; reject }, 
£ = {0}, T = {U,0, x}, qı is the start state, and the transition function 6 is given by Figure 2.3. 


Figure 2.1: Transition function for TM that decides language A = {0?" |n > 0}. 
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We write ‘21 %2...UmGUlm41%m+2---Ln’ to denote that £1, %2,...,%m,lm+41,L%m+42;---,Xn are the first n 
symbols on the tape where x; is the left most symbol and all symbols after zn are blanks (n may be 0), the 
TM is in state q;, and the head is looking at symbol £m + 1. 


On input ‘0000’, M starts in state qı with 0000 written on the tape with blanks following on the right and 
the head looking at the leftmost 0. Hence, the initial configuration of the TM is ‘q,0000’. We demonstrate 
the TM M’s computation on the input ‘0000’: 


qi 0000 qs U «Oa q5 U xan 

q2000 qox0x Q2LLL 

xq300 xqo0x LqQgxvuux 

x0q40 LULGZx LLL 

x0xq3 LLX3 LLUQ2 

x0qg5x LLG5X LLL U accept 
xq50x LQ5LL 

g5x0x G5 LXLX 


The input ‘0000’ is accepted by TM M. 


We note that we overwrite the first symbol on the tape with a blank so that when moving back to the left 
from the end of the input to the start of the input we know we have found the start when we see a blank. 


